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Uncertainty  Modeling  and  Possibilistic 
Approach  to  Parameter  Estimation 


Abstract 


A  general  basis  is  established  for  modeling  uncertainty  and  concepts 
of  vagueness  through  a  combined  possibilistic-probabilistic  approach.  A  survey 
of  the  connections  between  probability  theory  and  fuzzy  set  theory  is  undertaken. 
New  results  concerning  parameter  estimation^given  both  statistical  and  vague 
or  natural  language  information  ,  are  presented.  Hew  discoveries 
involving  possibility  measures  and  linguistic  probabilities  are  aisui  demonstrated. 
Some  specific  topics  treated  include  analysis  of  conjunction  and  disjunction 
operators  within  a  general  setting,  relationships  between  possibilistic  and 
random  set  operators,  and  asymptotic  behavior  of  fuzzy  set  estimators. 
Application  to  the  development  of  a  correlation/tracking  technique  -  PACT  ; 
Possibilistic  Approach  to  Correlation  and  Tracking  -  is  presented  in  outline  form. 
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1 .  irJTRODUCTION 


This  report  is  the  final  paper  during  FY-82  for  the  project  "Combined  Possibilistic 
Approach  to  Parameter  Estimation"  under  the  aegis  of  the  Kaval  Electronic  Systems  Command, 
ELEX  6121,  Task  Area  XR-021-01,  Program  Element  61153  A  • 

Previously,  a  quarterly  progress  report  was  issued  by  the  first  named  author 
(  see  bT’Ood IIJ) ,  Because  of  the  delay  in  funds  for  the  project,  a  reduced  work  effort  for 
FY-82  has  resulted.  Consequently,  the  second,  third  and  last  progress  reports  have  been 
eliminated  in  favor  of  this  encompassing  summary  report  for  Fy-82. 

In  the  first  quarterly  report,  the  nature  and  range  of  the  associated  HOSC  IR/IED 
PACT  Project  (Possibilistic  Approach  to  Correlation  and  Tracking)  was  outlined.  The  project ' 
is  centered  about  the  PACT  algorithm.  Briefly,  the  PACT  algorithm  utilizes  probabilistic 
and  fuzzy  set  or  possibilistic  concepts  in  treating  statistical  and  semantic  based  infor¬ 
mation  for  the  data  association  and  tracking  problem.  Basically,  the  algorithm  operates 
upon  a  collection  of  information  attribute  error  distributions, or  equivalently,  matching 
tables  and  a  collection  of  prechosen  (relevant  to  the  given  scenario)  inference  rules. 

The  basic  output  of  the  algorithm  is  the  posterior  distribution  (  in  either  the  classical 
statistical  or  fuzzy  set  sense  )  of  correlation  ppssibilities  between  any  two  given  candidate 
track  histories  which  are  suitably  updated. 

The  scope  of  the  task  which  this  report  addresses  is  to  define  fully  the  inter¬ 
relations  of  possibility  and  probability  theory  so  that  practical  quantitative  applications 
can  be  developed.  This  obviously  relates  directly  to  the  PACT  Project.  Rigorous  techniques 
must  be  developed  for  dealing  with  estimation  problems  which  contain  within  their  formulatior 
further  connections  between  possibility  and  probability  theory.  Specifically,  this  inclvides, 
as  odlined  in  a  previous  communication  (  see  5ct,usttr  C2J)  ; 

(a)  Determination  of  proper  possibilistic  conjunction  and  disjunction  operators 

(b)  Development  of  relations  between  fuzzy  set  operators  and  ordinary  set  ones 


(c)  Derivation  of  a  sampling  theory  which  parallels  random  sampling  theory 
for  both  large  and  snail  sample  sizes. 

It  should  be  noted  that  the  first  quarterly  progress  report  addressed  in  part  the 
last  mentioned  issue. 

This  report  consists  of  a  main  overview  text  written  jointly  by  both  authors,  which 
contains  :  An  Introductory  section  (1)  scoping  out  the  paper's  purposes;  A  section  (2)  con¬ 
cerning  motivation  for  the  analysis  of  fuzzy  sets,  random  sets,  and  their  connections 
through  the  presentation  of  a  general  example  followed  by  some  discussion;  A  section  (3)  on 
the  framework  of  analysis  consisting  of  the  topics  :  internal  vs.  external  modeling,  preling* 
uistic  concepts  and  ideas  obtained  through  natural  language,  concept  of  fuzziness  as  a  prima-' 
tive,  development  of  general  logical  systems  and  ambiguities,  relationships  between  fuzzy 
sets  arid  their  operations  and  probabilistic  concepts.  A  section  (4)  on  logical  (  or  fuzzy 
set)  systems  centering  about  a  procedure  for  choosing  a  particular  system;  A  section  (5) 
concerning  Manes'  important  generalization  of  probabilistic  and  min-max  fuzzy  set  systems, 
with  a  new  result  characterizung  Manes'  system  relative  to  general  fuzzy  set  systems;  and 
finally,  a  section  (6)  concerning  open  issues  and  general  conclusions. 

The  first  appendix  (l.R.  Goodman)  is  a  thorough  mathematical  siu'vey  of  the  various 
relations  betteen  possibility  theory  and  probability  theory.  In  section  10  of  this  appendix, 
there  is  a  series  of  new  results  concerning  parameter  estimation,  for  any  given  arbitrary 
combination  of  probabilistic  or  possibilistlc  input  descriptions.  The  second  appendix,  part 
one  (l.R.  Goodman)  i;;  an  outline  -  in  slide  form  -  of  the  PACT  Project,  a  direct  conse¬ 
quence  of  earlier  and  ongoing  work  in  parameter  estimation  (as  mentioned  above  in  the  first 
appendix).  The  second  part  of  Appendix  B  (  l.R.  Goodman)  is  essentially  the  same  as  the 
latest  paper  summarizing  the  theoretical  structure  of  PACT,  which  has  been  submitted  for 
inclusion  in  the  Proceedings  of  the  Fifth  MIT/oNR  Workshop  on  C^  Systems,  1982.  The  third 
part  of  Appendix  B  (l.R.  Goodman)  is  a  brief  siunmary  of  basic  fuzzy  set/random  set  theory 
for  background  purposes.  Finally,  the  last  two  appendices  (Appendix  C  and  D  )  (H.T.  Nguyen) 
are  surveys  and  analyses  of  two  topics  of  key  interest:  possibility  measures  and  linguistic 
probabilities . 
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2.  MOTIVATION 


Consider  tne  following  example  i 

Example  1. 

Two  target  histories  of  Interest  are  being  considered  by  a  sensor  operator 
for  possible  correlation.  He  receives  information  labelled  as  A^^  ,  A^  : 

A-]_  -  two  dimensional  position  observations  with  assoviated  updated  error 

ellipses  of  some  prescribed  confidence  level 

A2  -  reports  concerming  tentaive  classification  of  targets, such  as  Filipino 
Type  Q4  or  Liechtensteinian  Type  R7.9 

A^  -  vlaual  sightings  including  partial  identifications,  clues,  hull  lengths, 
mast  shapes  ,  etc. 


Clearly,  if  Infonnation  categories  A2  and  A^  are  ignored,  statistical 
hypotheses  testing  theory  may  be  applied  to  Aj^  to  esi/ablish  a  standard  weighted  metric 
(Mahalanobis  distance  -  see  e.g.,  ^"3.0  £3  ”]  jCKaptr  S’)  for  testing  for  correlation 
and  determining  the  level  of  correlation  (statistically)  between  the  two  track  histories 
of  interest.  Rough  gating  procedures  coxild  then  be  added  to  see  if  Ag  and  A^  confirm 
or  perhaps  contradict  the  crucial  geolf.cation  criterion  results  for  A^  .  (See  the 
Naval  Ocean-Surveillance  Correlation  Handbook  (■^1,L53  )  for  a  listing  and  descriptions 
of  tracking/correlation  systems  utilizing  the  above  procedure.)  But,  how  should  gates 
or  their  softer  distributional  analogues  be  systematically  established  for  A2  and  A^ 
and  integrated  with  the  results  for  A^  ?  Furthermore,  can  we  use  human  in-field  oper¬ 
ator  experience  to  relate  in  some  way  information  matches  ,  mismatches,  and  everything 
in  between,  occurring  for  categories  Ag  and  A^  and  A^  ,  as  well,  to  correlation  levels? 
This  problem  will  be  solved  in  detail  later  in  the  reporti  Indeed,  this  example,  is  a 
siii5)lificatlon  of  the  problem  that  the  PACT  algorithm  addresses.  (See  Appendix  B.) 

In  the  above  example,  the  parameter  of  interest  is  the  true  correlation  level  . 


other  exaaples  of  related  natxire-  both  militarji  and  non-military-  may  be 
found  in  Goodman  tsi  .  The  above  example  motivates  us  to  formulate  the  following  I 

scheme  for  dealing  with  parameter  estimation  problems.  We  need  to; 

(1)  Categorize  the  incoming  information  into  subcategories  as  ,  .... 

These  categories  should  be  carefully  chosen  for  nonredundancy.  Further  analysis 
of  their  taxonomy  should  prove  useful. 

(2)  Establish  a  rigorous  and  systematic  framework  for  quantifying  information.  This 
may  be  identified  with  the  problem  of  determining  the  natural  domains  of  attributes 
A^  ,  A2  ,  A^  ,  ...  .  For  example,  in  Example  1,  A^  's  domain  consists  of  all 
ordered  pairs  of  2  by  1  vectors  and  ellipses,  while  for  A^  ,  perhaps  simplified 
labels  such  as  q4  ,  R7.9  >  S6  ,  etc.  will  do. 

(3)  Derive  matching  level  tables  or  equivalently  error"distributions"(ln  a  sense 
possibly  extending  the  classical  statistical  ones)  that  can  occur  between  what 

is  reported  or  observed  and  what  the  true  values  are  for  each  attribute  category. 

(4)  Determine  relative  weights  of  inqjortance  between  the  various  attribute  categories. 
For  example,  how  much  will  we  tolerate  a  total  laismatch  with  respect  to  A^  ,  when 
a  relatively  good  match  occurs  relstivo  to  A^^  ? 

(5)  Establish  logical  connections  -  based  on  either  physical  considerations  or  human 
operator  experience  -  between  the  various  information  categories.  These  connection: 
could  be  either  in  the  form  of  inference  —  modus  ponens  rules  or  posterior 
distributions  constraining  or  delineating  the  unknown  parameter  of  interest. 

(See  Goodman  C  7]  -  l9J  for  earlier  outlines  for  approaching  parameter  | 

estimation  when  some  of  the  informational  input  is  in  linguistic  based  format.  See  also  \ 
tiol  ,  section  10,  for  extensive  theoretical  results.  Note  that  essentially,  Appei.dix  A 
of  this  paper  is  tlol  ,  while  Appendix  B,  part  two  is  [9]  .) 

More  generally,  we  might  ask:  How  do  we  model  uncertainty  and  conclusions 
concerning  this  within  a  general  framework? 

-5- 
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Obviously,  once  we  remove  ourselves  from  "hard"  statistical  Information,  subjectiv; 
ity  and  personal  interpretive  variation  play  important  roles.  The  logical  connections 
mentioned  in  item  5  above  are  usually  given  in  the  form  of  modus  ponens  inference  rules 
or  posterior  -distributions.  In  the  latter  case,  at  least  for  the  classical  statis^cal  | 
situation,  Bayes'  Theorem  is  usually  invoked  with  respect  to  more  basic  conditional  \ 

data  and  prior  distributions.  Fcr  the  former  care,  predicates  restricting  or  describing  i 
the  unknown  parameter  of  interest  and  other  parameters  or  values  determined  through 
various  attribute  categories  are  related  through  an  "if  (  )  then  (  )  "  structure.  ; 

Schematically,  we  have  the  restrictions  on  unknown  parameter  Q  ,  say  : 

"If  P(Z)  thenV(Q)  "  . 

The  lefthand  side  represents  the  posterior  distribution  (possibilistic  or  ordinary  - 
see  Appendix  for  clarification  and  explanation  of  possibilistic  distributions  ) 

of  Q  given  data  Z  ,  while  the  righthand  side  represents  the  inference  rule  "  If  P(?) 
is  true  then  V-'Q)  must  also  hold  "  ,  where  P(Z)  is  some  predicate  describing  Z  and 
V(0)  is  some  predicate  describing  Q.  For  example,  let  Z=(z( l),Z' 4))  ,  with  Z^I)  • 

(4^>.  and  z( J)=(Zi( J),Z2^>^)  )  ,  the  superscript  i  referring  to  data  for  ; 

track  history  i  and  j  for  track  history  j  ,the  subscript  1  referring  to  attribute  category 
Aj^  and  2  referring  to  attribute  ^  .  Then  ,  we  may  let  ,  for  example,  ; 

P(Z)  =  and  very  mildly  (  or  to  a  low  level)  match 

and  Z2^^^  and  strongly  match 

*} 

V(Q)  =  correlation  level  Q  is  high  at  least  . 

The  words  "very  mildly*  ,  "strongly"  ,  "high  at  leasjr"  could,  if  siiff icient  information 
were  present,  be  replaced  by  more  quantitative  values  such  f  3  ’ 

each  ^  is  some  number  between  0  and  1  indicating  the  intensity  of  matching  level. 

iv 

(Again,  see  Appendix  B  for  clarification  and  elaboration  of  this  idea.) 
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It  should  be  noted  that  many  posterior  distributions  and/  or  inference 
rules  may  be  present  which  delineate  the  possible  values  of  Q  given  Z  . 

WiUh  the  problem  modeled  according  to  the  above  mentioned  scheme,  the  next 
basic  question  concerns  the  actual  njathematization  or  translation  of  the  problem  into 
symbols  which  can  be  manipulated  according  to  some  established  calculus.  How  do  we 
translate  the  problem  into  a  consistant  rigorous  framework?  What  means  do  we  use  to 
translate  the  atomie  or  fundamental  inforgiation  parts^'  Hoa  are  compound  informational 
parts  to  be  exhibited  through  appropriate  choice  of  operators  ?  Which  parts  of  the 
problem  are  more  amenable  to  ordinary  statistical  /  probabilistic  analysis  and  hence 
modeling  and  which  parts  to  possibilistic/  fuzzy  set  modeling?  Certainly, natural 
language  descriptions  appear  more  easily  put  into  fuzzy  set  structure  than  classical 
probabilistic  ones  .  (SeeQIJferasunfo)  On  the  other  hand,  even  concepts  that  may  appear 
statistically  descrlbable  may  also  be  modeled  via  fuzzy  set  theory.  Fee  example, 
classification  often  entails  rather  overlapping  possible  values  or  classes,  due  to 
the  vector  of  subcategories  in  which  an  object  has  to  lie  to  qualify  to  be  in  a  par¬ 
ticular  class.  Indeed,  some  classes  may  actually  be  subsets  of  others.  In  addition, 
it  is  possible  that  the  exact  definitions  for  the  classes  themselves  are  vague  and 

; 

moreover  the  relations  between  the  classes  may  not  be  clear.  For  example  ,  could 
contain  C  and  D  ,  which  are  defined  by  knowledge  of  frequencies,  ship  size,  shape, 
and  number  of  engine  emitting  energy  sources  on-board.  Overlaps  between  C  and  D  may 
obound.  Thus  it  is  not  appropriate  to  considei-  o'dinary  probability  distributions 
over  Ag  ,  since  the  elementary  events  C  and  D  ,  among  others  for  example,  are  not 
distinct  or  disjoint.  Rather,  because  of  the  overlapping  flavor  of  A^  ,  either 
random  subsets  of  more  generally  certain  equivalence  classes  of  random  eubsets 

of  Ag  (  equivalence  here  is  in  the  sense  of  having  the  same  one -point  coverage  function 
Llo]  )  or  (the  same  as  )  fuzzj-  sets-  \ 

I 

Analysis  of  uncertainty  in  its  most  general  form  requires  modeling  and 
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measuring  imprecise  concepts' expressed  by  natural  language.  By  natural  language,  ve  mean  | 
that  medium  through  which  all  human  ideas  are  formed  Including  classical  set  theory 
and  xwo-valued  logic  as  well  as  more  ambiguous  concepts  including  "tall"  ,  "happy"  . 
Gaussian  distiributlons  ,  uniform  distributions,  "within  3  units  of"  ,  "close  to"  , 

"almost  all"  ,  "  there  exists"  ,  "  approximately  a  subset  of  to  degeee  0.6  "  ,  "  member  of 
set  G  "  ,  approximately  a  member  of  H  to  degree  O.U"  ,  etc. 

The  difficulty  with  natural  language  modeling  used  as%irect  tool  for  analysis 
is  she  disorganization  of  the  field.  Despite  the  heavy  ■'nfluence  of  pioneer  linguists  f 

Sapir,  Bloomfield  ,  Jespersen,  Boas,  Wliorf  (  and  the  famous  Whorf-Sapir  hypothesis  on  | 

5 

language  restricting  ‘che  thoughts  of  the  native  speaker)  and  the  later  work  of  formal  | 

linguists  Hiz,  Harris,  and  Chomsky  ,  among  others  (  see  ClB]-  C|9]  )  ,  what  is  evident  | 

is  that  a  unified  theory  of  linguistics  entailing  both  semantics  (meaning)  and  syntactics  | 

(operations,  form)  is  needed  which  is  suitable  for  complete  mathematization.  One  candidate; 

I 

approach  is  due  to  Zadeh  i  IfJ  using  fuzzy  set  theory.  (  See  also  the  work  of  1 

Grenander,  for  a  different  perspective  .  )  1 

1 

other  approaches  to  the  modeling  of  uncertainties  which  do  not  deal  directly  S 

f 

with  the  modeling  and  emulating  of  natural  language,  but  do  treat  the  information  content  \ 
content  contained  therein.  Include  : 

1.  Probability  theory,  including  random  variables,  random  functions,  and  more 

» 

recently,  random  sets  . 

2.  Multivalued  logic/  truth  theory  and  the  ensuing  set  theory  developed  from  it  ; 

3.  Fuzzy  set  theoiy  /  possibility  theery# 

4.  Flou  CT  luultiple  set  theory#  This  includes  interval  and  sensitivity  theory. 

5.  Extremal  entropy  techniques.  This  area  could  optionally  be  treated  under 
probability  theory,  because  of  its  close  relationship. 

6.  Derapster-Shafer  uncertainly  theory-  belief,  doi.bt,  plausibility  measures  , 
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The  basic  analysis  of  uncertainty  modeling  revolves  around  a  series  of 
general  topics  : 

1.  Internal  vs .  external  modeling. 

♦  I 

In  the  internal  approach,  explicit  analytic  relations  are  sought  connecting  j 

one  approach  to  uncertainty  to  another.  For  example,  Negoita  and  Ralescu,  through  their 
Representation  Theorem  (  see  [2  )  tied  up  very  neatly  classical  fuzzy  set 

operations  with  flou  set  operations.  As  another  example  of  the  internal  approach,  ; 

Goodman,  Orlov,  Nguyen,  and  Hohle,  among  others  (  see  demonstrated  ■ 

direct  connections  between  random  sets  and  fuzzy  sets  and  certain  of  their  operations. 

In  the  external  approach,  unifying  generalizations  are  sought  which  reduce  to 
various  approaches  to  uncertainty  modeling.  Here  the  work  of  Hirota  ([25J  >  SchefeBS 
Gaines  r^r)  may  be  cited  for  developing  structures  that  simxoltaneously  generalize  | 
probability  and  fuzzy  set  systems.  The  most  far  reaching  work  in  this  area  is  due 
to  Manes  who  derived  a  collection  of  axioms  which  not  only  generalize  1 

probability  theory  m»n-r'UX  fuzzy  set  theory,  but  a  whole  host  of  other  systems, 
including  topological  neighborhood  theory  and  credibility  theory.  (See  section  5  for 
more  details  on  Manes'  work,  where  it  is  shown  certain  restrictions  must  be  imposed  on  j 
fuzzy  set  systems  to  satisfy  Manes'  axioms.) 

2 .  Prelingulstic  concepts  and  ideas  .obtained  through  natural  language . 

This  topic  concerns  itself  with  the  ability  of  natural  jnnguage  to  express 

ideas  accurately  and  succinctly  as  well  as  the  formalizihg  or  mathematizating  of 
natural  language  for  dealing  with  uncertainties.  Comments  uere  made  previously 
the  lack  of  progress  in  this  ertremely  difficult  area.  Ironically,  we  can  express 
within  a  few  words, ideas  such  as  love,  happiness,  temporal  vague  concepts,  am-  I 

biguous  descriptions  -  which  are  perfectly  understandable  to  another  reasonably 

j 

educated  speaker  ,  as  well  as  various  combinations  and  operations  on  this  ideas  -■  ? 

yet  cannot  express  this  concepts  easily  within  a  rigorous  framework  in  terms  of  all 


the  component  prlmative  or  atomic  parts.  On  the  other  hand  "complicated  "  mathematical 
terminology  ,  such  ns  is  typically  found  in  category  theory  or  algebraic  topology  or 
deductive  logic  studies,  really  express  concepts  far  simpler  in  nature  than  what  lan¬ 


guage  can  express.  (  Of  course,  we  cannot  discount  the  abil^y  of  language  to  represent- 
albeit  how  awkward-  pure  mathematical  concepts  .) 

3 .  Qonee^t  of  fuzzines  a^  a  primative 

It  is  the  firm  conviction  of  both  authors  as  well  as  Zadeh  and  others  (  see 
€.9.  )  that  because  mathematical  analysis  has  shswn  that  fuzziness  is  1 

a  weak  form  of  randcmmess  ,  l.e.,  a  looser  type  of  randomness  without  the  constraints 

I 

of  the  probability  distribution  entailed,  fuzzy  nets  and  their  operations  are  a  natural 
tool  to  express  linguistic  concepts  ,  ratlier  than  prcbnoility  distributions.  Thus, 
the  fundamental  idea  of  a  point  partially  belonging  to  a  set  with  degree  specified  as  3 
some  ntunber  between  0  and  1  may  well  be  taken  as  an  intuitive  concept  representing 
the  possibility  that  the  point  is  in  the  set,  rather  than  the  probability  it  is  in  the 
set  (  the  set  now  considered  as  a  random  set  ).  (See  Appendix  •for  the  development 
cf  ejQ)licit  relations  between  fuzzy  sets,  random  sets,  and  random  variables.  Essentially 
fuzzy  set  -with  similar  results  valid  for  many  fuzzy  set  operations-  is  equivalent  | 

mathematically  to  the  class  of  all  random  sets  which  have  in  common  the  same  one-point 
coverage  function,  namely  the  membership  function  of  the  given  fuzzy  set.) 

4.  ^Je^elopme^  of  general  logical  (multivalued  logic)  systems  .  Ambiguities .  j 

This  topic  is  a  basis  for  further  work  in  developing  unified  approaches  to  j 

fuzzy  set  modeling.  Too  often  in  the  past  (  see  for  example,  Dubois  and  Prade  L  M3  )  '! 

myriad  distinct  fuzzy  set  systems  have  been  proposed  for  use  in  modeling  uncertainties,  J 
without  paying  attention  to  the  inherent  ambiguity  of  defibition  present.  More  specific¬ 
ally  ,  consider  the  problem  of  defining  an  appropriate  concept  for  the  intersection  of 
two  fuzzy  sets.  Originally,  Zadeh  (Jf^SDQl)  proposed  that  minimum  as  an  operation  on 
the  respective  membership  functions  was  the  most  appropriate.  Later,  ypHHjna-n  and  Giertz 
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i 

^3  I  1  were  among  the  first  to  justify  on  a  rigorous  basis  the  use  of  minimum  as  an 
intersection  operation.  (  See  aiso  the  survey  of  Elemeni^on  rigorous  characterizations 
of  varnous  fuzzy  set  operations,  including  intersection,  union,  complementation.)  However, 
the  justification  required  certain  constraints  (  mutual  dlstributivity  )  which  are  not 
realistically  required  within  a  general  setting.  Other  definitions  for  intersection  resulted, 

) 

ir-cliidingr  the  use  of  product  -  also  justified,  with  again  apipropriate  restrictions.  (Again,  | 

1 

see  the  Dubois  and  Prade  survey  CIH  .)  Clearly,  minimum  and  product,  while  both  extending  ! 
ordinary  intersection  (relative  to  zero-one  type  membership  functions  )  are  considerably 
different.  Which  one  to  choose  or  not?  The  answer  to  this  problem  may  well  lie  in  defining 
an  entire  class  of  fuzzy  set  operations  -  not  just  a  single  operation-  which  in  the  most 
natural  way  abstract  the  ordinary  concept  of  intersection.  Such  a  class  has  been  proposed 
( see  KLement  and  Goodman  )  ,  called  the  class  of  t  -noi'mE  (  a  term  borrowed  | 

from  a  branch  of  profcebiLity  totally  independent  of  fuzzy  set  theory,  developed  by  Schweitzer 
and  Sklar  I  33  i  based  on  earlier  proposals  of  Menger  C34j  ) .  these  operators  are  j 

symmetric,  associative, usually  assumed  also  continuous,  obey  certain  boundary  conditions 
for  compatibility  with  prdinary  intersection,  are  nondecreiasing  in  their  arguments,  and 

numerically  ox©  bounded  above  by  (  the  largest  t-norm)  the  minimum  operation.  (See 

[S3]  pro(>crti<>s)  See  also  Haack  [353  and  Rescher  for  listings  of  multivalued  logic 

systems  where  special  cases  of  t-norm  and  t-conorm  operators  are  used  f o/*&**and *or”. ) 

Similary,  other  classes  of  definitions  may  be  developed  for  union  (t-condrms) 
complement  (involutions)  ,  and  in  turn  these  general  djf initions,  a  la  multivalued  logic 
may  be  used  to  develop  general  compound  fuzzy  set  operations  and  relations,  including 

t 

the  quantifications  "for  all''and  "there  exists"  ,  as  well  as  subset  and  £irithmetic  (in  a  1 
fuzzy  set  sense)  relationships.  In  addition,  this  leads  to  the  general  concept  of  conditional! 
fuzzy  sets  (  analagous  to  conditional  prebubility  distributions  )  ,  fuzzy  set  Bayes'  theorem! 

I 

and  in  turn,  a  theory  of  small  and  large  fuzzy  set  sampling  .  (See  [37^  •*) 

Even  with  the  general  unifying  approach  as  described  ,  problems  of  ambiguity  of  ■ 

( 

definition  still  arise.  For  example,  the  fuzzy  set  quantifier  "for  all  x  in  X,  (  )  holds"  ; 

be  definable  by  the  relation  ,  as  expressed  in  English,  "()&()&()&...&()", 

Xt  ^  Xn 

'U- 


where  (  represents  some  relationship  such  as  "if  xj  is  in  A  then  Xjis  in  B  ",  varyipg' 

j 

over  the  universe  of  discourse  X  ,  and  where  A  and  B  are  fuzzy  sets  predetermined  here. 

On  the  other -hand,  the  same  concept  could  conceivably  be  expressed  directly  by  a  unary  { 

operation  on  j  which  is  a  fuzzification  of  "for  all"  ,  i,e.,  &  oohotonically  increasing 

function  over  the  unit  interval  which  rises  sharply  towards  one  neor  domain  value  one  and 
'^hich  otherwise  is  zero  before  these  values.  (Similar  monotonic  operations  are  used  in  fuzzy ' 
set  theory  to  define  "almost  all",  "at  least  most",  etc.)  It  is  easy  to  see  that  in  general^ 
though  again  the  two  concepts  extend  the  ordinary  meaning  in  zero-one  set  theory  of  for  all, 
they  represent  two  different  approaches  to  the  universal  quantifier.  Both  definitions,  it 
should  be  noted,  depend  on  the  general  t-norm  definition  of  lnterBectton( through  &  )  ,  the 
second  depending  as  well  -through  the  "if  C  )  thenC)**  relation  on  the  general  definition  of 

I 

ur-ion  and  complement.  Which  one  to  choose?  In  turn,  the  problem  of  appropriately  modeling  | 

a  particular  fuzzy  set  with  respect  to  the  corresponding  original  numerical  or  linguistic  ! 

concept  also  arises.  What  individual  variation  of  response  should  be  allowed?  How  specific 
should  the  universe  of  discourse  be?  For  exan^jle,  when  considering  the  fuzzy  set  "long  ",  i 
do  vie  consider  ships,  cars,  bothj  is  there  some  grand  scale  where  "long"  can  be  quantiatively I 
established  through  its  membership  function  ,  other  than  the  obvious  fact  that  it  is  some 
monotone  increasing  membership  function?  One  answer  to  this  problem  is  analagous  to  the 
problem  of  modeling  an  appropriate  probability  distribution;  peurameterize  and  then  chooce 
the  most  appropriate  value  of  the  parameter-and  hence  membership  function  from  the  collection 
through  some  estimation  technique  based  on  empirically  obtained  evidence. 


5.  Relationships  between  fuzzy  sets  and  their  operations  and  probabilistic  concepts . 


The  details  of  these  relationships  are  spelled  out  in  Appendix  A  .  Recalling  the 
last  comments  of  subsection  3  above,  given  a  fuzzy  set  ,  it  may  be  expedicious  to  choose 
one  particular  random  set  equivalent  to  it.  Which  one  to  choose?  How  much  information  loss 
occurs  when  one  random  set  is  chosen  as  opposed  to  the  entire  equivalence  class? 
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Could  some  mathematical  criterion  be  used  to  weed  out  this  random  set  such  as  maximal  entropy? 
What  about  semantic  content?  For  example,  condider  the  simple  fuzzy  set  representing  "tall". 
Clearly  ,  this  also  is  a  monotone  increasing  Itizzy  set  ,  i.e.,  the  membership  function  must 
be  monotonically  increasing.  However,  it  can  be  shown  that  among  the  equivalent  tandom  sets 
to  any  such  monotone  increasing  fuzzy  set  (see  e.g,  )^two  very  different  ones  can  be 

explicily  shown;  the  so-called  -type  , which  is  a  random  interval  with  right  end  point  fixed 
at  the  maximal  universe  of  discourse  element  ,  and  the  T-type,  whi  a  is  very  broken-up  in 
structiire  and  is  not  any  kind  of  interval.  Clearly,  the  first  is  more  compatible  with  the 
concept  of  tall-  if  one  point  is  covered  randomly  by  a  random  set  representing  "tall"  , 

shouldn't  all  points  to  the  right,  i.e.,  having  larger  heights?  Similarly,  there  may  be  a 
most  natural  choice  of  random  set  representation  for  a  given  fuzzy  set,  when  the  latter  has  a 
membership  of  some  prescribed  type,  such  as  unimodal,  continuous,  discrete,  step-form,  etc. 

In  ?  delated  vein,  we  may  pose  the  question  as  how  ibould  semantic  based  infonna* 
tion  ,  and  thus  fuzzy  sets,  be  combined  with  independently  derived  random  set  or  random  vari¬ 
able  information  concerning  a  common  unknown  parameter  vector  ? 

Finally,  it  is  of  importance  to  ascertain,  through  the  relationships  mentioned 
above,  if  random  set  theory  could  be  used  to  derive  results  for  fuzzy  set  theory  . 

A  general  schematic  outlining  the  various  approaches  to  uncertainty  modeling 
is  given  in  Figure  1. 
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Figure  1.  Schematic  Outlining  Various  Approaches  to  the  Modeling  of  Uncertainties 
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4.  LOGICAL  OR  FOZZY  SET  SYSTEMS  ;  CHOICE  OF  A  PARTICULAR  SYSTEM 

All  of  fuzzy  set  theory  can  be  developed  in  a  natural  way  directly  through  homomorphic- 
like  evaluations  from  multiple  valued  truth  theory  .  In  turn,  multivalued  truth  theory  can 
be  motivated  through  natural  language  analogues  consisting  of  attributes  and  linguistic 
operators . 

In  natural  language,  there  exist  many  compound  attributes  and  operators  built  up  from  ' 
more  primative  ones.  Three  connectives  play  a  very  significant  role  in  natural  language  des¬ 
criptions  :  "not"  ,  "and"  (  usually  denoted  by  &  ),  and  "or"  ,  It  can  be  shown  that  all  other 
logical  connections  can  be  reduced  to  these  in  classical  two-valued  logic.  Indeed, 
theoretically,  all  operations  can  be  reduced  to  one  operator  ,  Shefer's  stroke  operator  or 
alternative  denial  (see  38  , sect. 1.5).  More  recently,  it  has  been  shown  (see  )  that  for 

multivalued  logic  systems,  a  similar  reduction  is  also  formally  valid.  In  apycase,it  is  natmral 
to  begin  with  a  small  collection  of  primative  logical  connectives,  add  procedures  for 
compounding  them,  and  denote  the  more  important  results  by  particular  terms.  We  will  call 
the  triple  of  operators  (  not,  &  ,  or  )  a  logical  (  or*’fuzzy  set  )  system.  The  interpretation 
of  this  triple  of  operators  -  with  some  collectionlf  of  predicates  or  sentences  subsumed  on 
which  these  operators  act-  will  be  at  three  conceptually  different  levels  :  linguistic  , 

i 

multivalued  logic,  and  fuzzy  set  (  or  numerical).  The  operator  not  is  a  unary  opera  .or  on  f 

while  &  and  or  are  binary  operators  over  Difficulties  arise  as  to  the  numerical  evaluation 

of  these  operators,  at  the  fuzzy  set  interpretation.  For  example  (  as  stated  earlier  in  this 

text.)  &  could  yield  both  product  and  minimum  as  interpretations  at  the  fuzzy  set  end.  Which 

to  choose  or  other  operators  to  consider?  As  Bcntloned  previously, , a  basic  choice  of  per-  ; 

\ 

missible  operators  for  a  logical  system  is  for  net  to  correspond  to  some  decreasing  involutive  < 

i 

operator,  while  &  corresponds  to  some  t-norm  and  or  to  some  t-conorm.  Other  choices  for  ; 

interpreting  &  and  or  may  lose  the  flavor  of  what  we  really  mean  by  "and"  and  "or"  .  For 
example,  it  is  possible  that  the  weighted,  sum  operator  (  see  )  -  which  is  its  own 

Deldorgan  dual  (  in  general,  &  and  or  can  be  interprted  so  that  they  are  not  in  the  classical  : 

DeMorgan  relationship  )  -  could  be  chosen  in  place  of  &  and. or  for  a  logical  system  ,  But 

note  that  this  averaging  type  of  operator  is  neither  a  t-norm  nor  a  t-conorm. 
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Choice  of  a  specific  logical  system  -  i.e.,  a  specific  triple  of  admissible  operators 
for  not,  &,  or  -  should  be  based  on  soms  combination  of  prahtlcal  considerations  and  theoret¬ 
ical  basis.  It  is  shown  in  Appendix  A  ,  Theorems  10-12  ,  that  the  subfamily  of  semldlstrlbu- 
tive  t-norms  and  t-conorms  (  DeMorgan  property  may  be  assumed  )  provides  a  theoretical  basis 
of  operators  to  choose  from  in  setting  up  a  logical  system  ,  when  not  is  associated  with 
the  fuzzy  set  operator  !-(•)  .  This  basis  essentially  allows  weak  homomorphic  identification 
of  arbitrary  combinations  of  the  t-horm  and  t-conorm  operators  in  question, as  well  as  a  large 
class  of  fuzzy  arithmetic  and  functional  transform  operators  involving  these  t-norms  and  t- 
conorms,  with  naturally  corresponding  ordinary  intersections  and  unions  relative  to  ranlo« 
sets  (equivalent  in  the  usual  one  point  coverage  sense  to  the  original  fuzzy  sets  and  deter¬ 
mined  also  by  the  choice  of  t-norm  and  t-conorm, with  respect  to  Jointness  of  distributions). 
With  the  theoretical  basis  established  firmly  :  we  should  only  in  general  seek  those  t- 
norms  and  t  conorms  which  are  semidistributive  ,  we  must  use  the  structure  of  a  given  scenario 
to  further  define  the  appropriate  choice  for  the  logitral  system  to  be  used  for  the  modeling. 


In  review  (  see  ),  the  semidistributive  family  of  t-norms  consists  of  all 

discrete  weighted  sums  of  the  form 

m+1  m  m4-l 


m 

-  !  5i'<=<k  * 


m 


L  > 


k=l 


k=l 


k=l 


k=l 


where  the  wieghts 

o(j^  =  ^  “  ^k  J  L,2,..,m+1 

0=bQ  <  a^  <  bj^  <  a2  <  b^  *  *  *  —  ®m  ^  ^  ^m+1  fixed  arbitrary  constants  ; 

bivariate  probability  distribution  function  corresponding  to  the  random  vector | 

and  tlrius 


each  F}^  is  that 


in  which  case  , 


/Ui\  -where  U-,=U2  is  unifc<rr.-ly  distributed  over  the  interval  (^b^^ 

VU2/ 

Fj^l(y))  f  0  iff  (y)  is  in  the  square  ,  ajJX  »  ^k^  » 

F^((y]  )  =  min(  (x-\-l)/(^k“\-l^  »  ’ 


i 


each  Gj^  Is  that  bivariate  probability  distribution  function  corresponding  to  the  random 
vector  ,  wnere  now  and  are  statistically  independent' identically  distributed 

uniformly^ over  the  interval  Caj,  ,  b^3  ,  thus  ^ (J)  )  #  0  iff  is  in  the  square 

C  ^  ]  X  C®k  /  which  case, 

Gk((y)  )  =  ((x-\)/(\-ak))  •  (  (y-\)/(bk-ak))  , 

Note  the  important  special  cases  =  min  and  =  prod. 


Suppose  now  that  a  given  scenario  holds  so  that  operator  (t-norm)  'IP  is  obtainable 

& 

at  leasir  approximately  empirically  through  its  use  ,  by  a  tabulation  of  its  values  over 

the  unit  square.  In  genferal,  this  empirically  obtained  function,  denoted  by"^  is  not  a 

o  & 

semidistributive  t-norm.  However,  we  can  approximate  by  a  semidistributive  t-norm, 

determining  the  coefficients  and  ^  in  the  expansions  given  above  by  matching  moments 

K  k  ^ 

to  any  degree  desirable  between  V  and  W  ,  Since  the  moments  of  F  and  G  are  partic- 

&  &  .  k  k 

ularly  easy  to  obtain,  we  immediately  obtain  the  fundamental  relations 


)  =  (l/(VVl))'li  (\ 

k=l 


Vi  +Y2  +1  ^ 


k=l  ^ 

o 

where  the  (  central  moment  for  is  given  by 

><  (  ,^2)  =  X  J*  dVJx,y)  , 

/ over  all  \ 

I  x,y  in  the  j 
unit  squarej 

obtainable  by  an  approximating  discretization  ,  for  some  predetermined  size  of  m  and  choice 
of  equalities  to  hold  in  the  above  equation  for  the  ^k*^  '^1  "^2 

run  separately  over  the  integers  0,l,2,..,q  ,  for  some  appropriate  choice  of  q. 


We  then  seek  to  solve  tJie  above  fundamental  relations  for  the  coefficients  a,  and  b,, 
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in  terms  of  the  empirically  known  ■M  (Yi 

For  earlier  empirical  approaches  to  the  determination  and 

the  work  of  Zimmermann  [40]  and  Hersh  and  Caramazza  [41], 


or 


,  see 
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5.  BASIC  CRITIQUE  ANi)  EpOPSIS  MANES*  GEI^RALIZED  UNCERTAIi'"rY  THECRr 

Manes  has  recently  written  one  oi  the  most  important  papers  taking  the 

external  approach  to  the  analysis  of  uncertainty  modeling.  (See  the  earlier  p'ipers  of  Gaines  I 
and  Hirota  US)  for  much  more  restrictdd  approaches  to  the  development  of  systems 
which  extend  both  probability  and  fuzzy  set  concepts.)  Because  of  the  paper's  great  import¬ 
ance  and  relative  difficult  format,  a  synopsis  with  some  critical  comments  will  be  presented 
here. 

In  summary.  Manes  derives  a  general  class  of  "fuzzy"  theories  which  reduce  as 
special  cases  to  finitely  discrete  probability  theory,  Zadeh's  original  (  see  C303  )  fuzzy 
set  system  (!-(•),  min,  max),  topological  neighborhood  theory,  credibility  theory,  and  other 
approaches  to  the  modeling  of  uncertainties.  (To  avoid  confusion  with  fuzzy  set  theories  as 
discussed  in  the  overview.  Manes'  models  will  be  designated  as  "fuzzy"  .)  Manes'  theories 
are  characterized  by  a  triple  of  functions  satisfying  three  basic  axioms.  The  first  function 
assigns  to  any  space  a  corresponding  space  of  geheralized  distributions  over  that  space  (  the 
term  "generalized"  to  be  made  more  specific  for  each  particular  system  satisfying  the  axioms) 
The  second  function  imbeds  or  identifies  eny  given  space  with  the  subclass  of  mass-point 
distributions  from  the  associated  space  of  generalized  distributions.  The  third  function 
extends  conditional  generalized  distributions  -with  index  set  X, say, and  distributions  in 
the  associated  space  T(y)  of  space  Y  -  to  operators  taking  initial  distribution  spaceTjX^ 
to  T(Y)  .  As  natural  as  the  first  two  axioms  are  (  see  below  )  In  determining  the  essence 
of  the  above  concepts,  the  third  axiom,  an  associative -like  condition  imposed  on  the  extension | 
function  (i.e.,  the  third  function  described  above)  may  be  too  restrictive.  This  is  because  5 


of  the  following  characterization  we  have' shown  ;  Let  F  =  (!-(•),  »  V  )  be  a  given  \ 

&  '  or  3 

fuzzy  set  system  (  recalling  that  If  is  some  t-norm  and  ^  is  some  t-conorm),  with  Q)  beings 

8e  or  • 

membership  function  binary  relation  composition  relative  to  F  .  Then  F  is  also  a  "fuzzy" 
theory  with  the  mapping  as  a  function  of  all  binary  fuzzy  set  relation  membership 

functions  4^  being  the  same  as  an  extension  function  in  Manes'  sense  ,  iff  If'  is  right  j 

R.  8c 


distributive  over  "'f' 


or 


As  a  consequence  of  this  result,  a  whole  host  of  fuzzy  set  systems 
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Including  the  important  system  (l-(  •)  ,  prod,  probsu-m)  vhich  plays  a  key  role  in  the  veak- 
homomorphism  theory  connecting  fuzzy  set  operations  with  those  ordinary  ones  cn  random  sets 
(see  AppendiK  ^  )  ,  do  not  satisfy  the  required  third  axiom  of  Manes'  "fuzzy"  thec-^ies, 

although  it  is  easily  verified  that  the  other  two  axioms  are  indeed  satisfied  always  by  any 
fuzzy  set  system:  Consequently,  the  elegant  results  obtained  for  Manes'  theories  do  not  apply 
to  non-right  distributive  fuzzy  set  systems.  The  natural  problem  that  follows  is  how  to  change 
the  requirements  of  Manes'  third  axiom  so  as  to  accomadate  a  larger  class  of  fuzzy  set  systems 

Next,  a  brief  treatment  with  some  analysis  of  Manes*  results  is  presented. 

i 

I 

A  "fuzzy"  theory  is  a  triple  ^  of  functions  so  that  for  all  well-defined 

spaces  X,Y,Z 

(  i)  T(X)  is  the  space  of  generalized  distributions  associated  with  X 

( ii)  e(X):X*^T(X)  is  the  special  function  called  the  imbedding  function  o£  X 
into  the  mass-point  distributions  in  T(X) 

X  fp/ 

(iil)  if  :  T(Y)  - - ^  T(Y)  '  *  is  the  extension  or  lifting  operator  ,  noting 

that  the  dependence  of  #  oh  X  and  Y  is  not  denoted  here. 

The  axioms .  •7'  must  satisfy  are  ; 

For  any  spaces  X,Y,Z  and  mappings  o(  :X  ' — ^T(Y)  ,  ^  :Y  — ^T(Z) 

(1)  (#(o())ce(X)  = 

(2)  #(e(X))  =  ident^^^j 

(3)  #((#(  P  ))o  a(  )  =  (#(  ^  ))°  (#(  o( ))  •  c  aenotin^  co/npositjon  of  functions  . 

Zadeh  .Fuzzy  Set  Theory  Example  _  F  =  (!-(•)>  min,  max) 

T(X)  -  Lo,l]  ■  and  (e(x)  (x))  (y)  =  S  ( Kronecker  delta)  •  x<-X,ytY  ai'b. 

((#(<(>  ))(  <^.  ))(x)  =  (  Dlin  (  cb  (x,y)  ,  (p  {y  )))=  4^  ^  (y)  ,  j 

R  A  X  €  X  "  ^  f 

for  any  fuzzy  oinaiy  relation  R  on  XX  Y  and  any  fuzzy  subset  A  of  X  ;aH  ygY  ) 

Finitely  Discrete  Probability  Theory  Example  | 

T(X)  =  {  p  (  p  is  a  probability  fxinctloii  over  X  with  finite  support}  | 
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(e(X)(x))f?)r  S  ,  for  all  xex  ,  y€Y  . 

A,y 

(#<q(  •'  1  •")))(p))(y)  =  5]  (  I  x)  •  p(-0)  =  E  (q(ylT))  , 

xCX  ^ 

for  all  conditional  probability  functiona  q  over  Y  ,  conditioned  on  X  ,  and  all 
p  €-  T(X)  ,  with  random  variable  V  distributed  according  to  probability  function 


Theorem  /\  Goodman-Nguyen,  1982  ) 

Let  F  =  (  !-{•), ^  )  be  a  given  f’lzzy  &et  '.ystem  with  (ip  denotin,-’ 

or 

the  fuzzy  set  binary  relation  composition  relative  to  F.  Thus  (  see  also 
moti’/ation  via  multivalued  truth  theory)  ®  is  defined  dually  as 

o,)(y)  -  (y) 


(y) 

(^^oJ^(R  (5?  CA  ®  Yl) 


X  €  X 


let 

(e(x)(x))(y)  ^  R  ,  for  all  x€X  ,  ycY  ,  X,  Y  arbitrary 

witli  ,  -r 

T(X)  3  CO,l]^  fot  all  X  , 

and  i'ifiz.ll'j  define 

,  for  all  fuzzy  binary  relations  R  on  X  K  Y 

R  A  H  A 

and  all  fuzzy  subsets  A  of  X 

Then  ; 

(1)  F  satisfies  Manes'  axioms  (1)  and  (2)  for  "fuzzy"  theory 

(2)  F  satisfies  Manrs'  axiom  (3)/  and  hence  is  also  a  "fuzzy"  theorj,  iff  V  is 

-  I  j. 

right  distributive  over  ^  i.e., 

^  "  ^or^  a,b,cG  Co,l2. 
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Proof  of  T;icore:.i 

Result  (l)  follows  from  straightforeward  algebra. 

For  result  (2)  : 

The  lefthand  side  of  Manes'  axiom  (3)  is  evaluated  as  ,  for  any  -  4*3  » 

and  (b  ,  where  R  is  a  fuzzy  relation  on  XXY  ,  S  is  a  fuzzy  relation  on  YXZ  ,  and  A  is  a 

A  ^ 

fuzzy  subaet  of  X,  and  z  e  Z  is  arbitrary 

i(E,s,A;z)  ,  i  V  {\( ( 4’„(x,y),  . 

x€X  yeY 


Similarly^  the  righthand  side  of  axiom  (3)  becomes 

ii(R,s^}z:)  i  (\(  , 

yeY  xfx 

If  if.  is  distributive  over  if  ,  then  by  simple  induction  ,  the  defining  equation  for 
' &  'or  ' 

right  distributivity  may  be  extended  to  arbitrary  number  of  arginnents  for  the  operator. 

In  turn  substituting  this  into  the  above  expressions  for  I  and  II  yields  the  relation 

l(R,S,Aiz)  =  Il(R,S,A;z)  =  x) ,  x,y) ,  4>2(y,z) ))  . 

/x€XV 

Vy€  Y/ 

For  the  converse,  if  axiom  (3)  is  satisfied  ,  then  for  all  R,S,A,z  as  above,  we  must 
have  I''.R,S,A;z)  =  Il(R,S,Ajz).  Choose  in  particular  A=X,  Y=(y)  ,  with  all  other  variables 
arbitrary.  It  follows  immediately  that  right  distributivity  holds. 


As  a  consequence  of  the  above  tharera,  Zadeh's  original  fuzzy  set  system  is  also  a 

"fuzzy"  theory  ,  as  is  the  non-Demorgan  system  (l-(’),  prod,  max)  .  On  the  other  hand,  the 
(DeHorgan)  fuzzy  set  system  (l-(*);Prod,  probsum),  and  extending  this,  any  semi -distributive 

fuzzy  set  system  (except  for  the  boundary  system  (!-(•)»  tiin,  max))  in  general  will  not  be 
right  distributive,  and  hence  will  not  be  a  "fuzzy"  set  theory.  Since  semi-distributive 
fuzzy  set  systems  are  the  main  link  in  the  weak  horomorphism  theory  connecting  fuzzy  net 
theory  with  random  set  theory  (  see  Appendix  A  foi'  details),  the  concepts  of  fuzzy  ar-d 
"fuzzy"  are  not  compatible  here. 
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Manes  Considers  the  set  of  truth  distributions  =  T{|^Tq  ^  1  )  >  vhere  (  not 

to  be  confused  with  the  function  T  )  and  Fq  are  fised  values  representing  truth  component 

and  falsehood  component,  respectively.  Alternativ'e]/,  Manes  could  have  considered  the  more 

standard  T( ^ T  ^  )  ,  or  pernaps  expanded  tne  truth  indices  to  three  or  more  such  as  in  1 

T(  /t  ,  F  ,  M  T  )  ,  where  M  is  some  intermediate  truth  index  such  as  "n’eybe".  | 

^  o  o  ’  ’  0  f 

In  addition.  Manes  ,  defines  "fuzzy"  theory  mappings,  quotients, canonical  subtheories,- 

P 

requiring  commutivity  for  all  relevant  arguments  and  functions.  For  example,  a  "fuzzy"  abstrac? 

i 

n-ary  operator  is  defined  as  an  n-ary  operator  (  on  the  Cartesian  product  of  generalized  ' 

distribution  spaces)  which  comniUtes  with  all  mappings  arising  from  the  extension  operation 

Because  of  this  restriction,  it  is  shown  (Manes*  Theorem  3*3)  that  any  such  operator  may  be 

always  identified  with  the  operator  (jKq))(p)  ,  for  Eooe  fixed  p * T( ^1, . . ,n})  as  a  function  ! 

of  q  =  (q.)  ;  q^e  T(X)  ,  j=l, ..,n.  Similarly,  a  "fuzzy"  homomorphism  P  :T(X)  - ^  T(Y) 

J  j=l,..,n  J  : 

is  characterized  by  its  ability  to  commute  with  all  abstract  n-ary  operators.  This  is  equi-  ! 
valent  (see  Manes'  Theorem  ^.1)  to  the  equation  ^ 

f  =  #(f  o  e(x))  ;  all  X  .  | 

Closely  related  to  the  above,  it  is  shown  that  ^  )  is  always  a  "fuzzy"  f 

homomorphism  between  T(X)  and  T(Y)  ,  when  o(  :  X — ^T(Y).  Extending  this  result,  it  follows  ■ 

that  for  any  f:X— ^Y  ,  T(f)  =  ^e(Y)of)  is  always  a  homomorphism  also  ,  which  respects 


identity  and  functional  composition,  as  well  as  one-to-one  ness  and  onto-ness.  (This  makes 
T(f)  as  a  function  of  f  a  functor  .  ) 

Zadeh  Fuzzy  Sat  Theory  Example 

T(f)  (  <^^)  =  sup  =  ^f(A)  *  f:X-^Y  and  c}5  e  T(X)  , 

Thus  T(f)  is  the  basic  fuzzification  of  functions -f. 


! 

! 


i 


Finitely  Discrete  Probability  Theory  Example 

(T(f))(p)  =  2  p(x)  =  probability  function  of  r.v.  f  (V )  ,  where  "V  has  probability 

xef-l(  .) 


function  p  . 


Manes  extends  the  idea  of  the  relationship  or  compatibility  of  an  ordinary  set  with 
a  generalized  distribution  ,  ar.d  in  tvtro  the  relationship  between  two  generalized  distributions 


as  follows  : 

d^(S,p)  i  (T(  gg  ))(p)  , 

where 

‘  >°  '^s  '  •  ' 

,  fT  ,  iff  x£S 

V  (x)  =  -J  °  ,  for  any  S  G.  X  ;  p  gT(X)  . 

S  1  F  ,  iff  x6  3 

(p,q)  =  (#(  I*}  #q)lKp)  ;  aii  p,q  e  t(x)  , 

noting  the  relation 

e<^  ((e(xKx),q)  =  ;  all  q  €  T(X)  ,  xC  X  , 

X 

These  relationships  reduce  to  quite  familiar  ones  for  fuzzy  set  and  probability  theorries; 
Zadeh  Fuzzy  Set  Theory  Example 

(4>^(x),(}>3(x)))  =  a) 

/x6X 
yfeY 
\  My 

(dZrn  (s,  4)  ))(T  )  =  sup(4P(x)) 

X  A  o  x€S  A 

(cfa^(s,  (pj^  ))  (F^)  =  sup  ((pj^(x))  ;  all  fuzzy  subsets  A  of  X  ,  B  of  Y 

X  ^  S 

Finitely  Discrete  Probability  Theory  Example 

^<^^(p,q)  =  Z/P(x)-q(x)  =  TriV  =\{) 

x€  X 

(S.  =  2p(x)  =  Pr(Y'6  S)  ;  all  probability  functions  p,q  over  X 

xes 

which  are  finitely  discrete  ,  where  r.v.  V"  corresponds  to  p  and  ~Vrto  q. 


min  ((f)j(x),(l3g(y))) 
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Define  the  imbedding  of  true  and  that  of  fals©  in  the  distribution  space  ^ 
\  =  (  e(  {^F^}  ))(T^)  ;  F,  =  (  e(  {t^,Fo]))(F^)  . 


Then  define  the  folloaing  properties  which  "fuzzy"  theories  may  or  may  not  possess: 

A  theory  is  anti  -^reflexive  iff  ^  (p,  p)  =  implies  that  p  =  (e(x))(x)  ;  ajl  ■ 
p€T(X),x6X  ,X  arbitrary 

A  theory  is  faithful  iff  ,  p)  as  a  function  of  p  is  one-one  and  onto. 

A  theory  is  propositionally  complete  iff  for  any  p,q£T(X)  ,  pfq  ,  there  exists  a 
separating  homomorphism  ,  for  some  ck  :  X — (j^( ))(*3)  •  ■ 

A  theory  is  consistent  iff  for  any  f,g:  X — ,  with  f#g  ,  T(f)  4  T(g)  ,  equivalent-- 
ly,  e(X):  X — ^TCx)  is  a  one-one  function.  | 


Summary  of  theorems  and  results  shown  by  Manes  for  the  above  properties . 

(1)  All  faithful  theories  are  propositionally  con5)lete.  I 

(2)  Except  for  two  degenerate  eases  of  no  interest,  all  theories  must  be  consistent.  ! 

(3)  Every  theory  has  a  largest  (canonical)  subtheory  with  crisp  points  ,i.e.,  T( {  x}  )  con¬ 
sists  of  exactly  one  generalized  distribution  for  any  x€X  arbitrary,  equivalently, 

'^(X,p)  =  T  for  all  peT(X)  and  xGX  ,  where  T  is  rissociated  with  the  suhtheory, 

X 

For  the  Zadeh  fuzzy  set  theory  exaii5)le,  this  condition  is  equivalent  to  the  class  of 

all  fuzzy  subsets  of  X  which  have  supremum  of  their  membership  function  being  1. 

IJcr  the  finitely  discrete  probability  theory  example  ,  T(X)  itself  has  crisp  points. 

(1)}  Both  examples  (Zadeh's  fuzzy  set  theory  and  finitely  aiscrete  probability  theory} 
possess  all  fear  theory  properties  defined  above. 

■ 

Generalization  of  theory  homomorphisms  ana  the  operator  ^  to  multivariate  settings 

and  relationships  to  joint  and  independent  generalized  distributions . 

An  n -homomorphism  relative  to  a  theory  is  a  mapping  f*  :  T(X2^)X»"*  X  ^  T(Y) 

such  that  ( 'P  I  T(X.)^  separately  (  all  other  spaces  fixed)  is  a  homomorphism  for  the  theory, 

J — 1  ^  j  n  • 
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The  space  of  all  joint  generalized  distributions  with  respect  to  X  and  Y  ia  T(xXY). 


For  any  p€T(X)  and  q€T(Y)  , 

S  (#(((#(  (e(XXY))(-,y)))(p))y^Y 

•  P^(p,q)  ^  (#((^  (e(XXY))(x,.)))(q)}^£X  ))(p) 


are  the  only  two  ways  to  minimally  extend  p  and  q  into  a  joint  seneralized  distribution  over 
X  and  Y  . 

Theorem  (Manes,  Theorem  5*7  and  related  material) 

(1)  ,  for  all  p€T(X)  and  all  q6T(Y)  ,  denoting  the  common  value  mapping  P  ,  | 

and  is  a  2-hc8nomorphism  (.with  respect  to  the  theory)which  extends  e(XXY)  uniquely 

iff  ibroC:  X^  )(  '  X  ^  T(Y)  ,  there  is  a  unique  extension  map 

o(  :  T(Xj^)X  •'••X  — >T(Y)  ,  noting  that  for  n=l,  o<  =  J^(o()  ,  for  all  possible  X 

iff  the  abstract  n-ary  operators  induced  by  p  and  q  commute  with  respect  to  composition,  i 
for  9.(1 

(2) For  any  •  commutat i ve  theory,  i.e.,  a  theory  in  which  any  of  the  equivalences  in  (l)  are  j 

valid  ,  the  operator  is  symmetric  in  dts  arguments. 

X 

(3)  For  any  commutative  theory,  having  crisp  points  is  equivalent  to  P  being  a  one-one  mapping! 

(^)  Both  Zadeh's  fuzzy  set  theory  and  finitely  discrete  probability  theory  are  commutative 
theories . 

8  ; 

i 

The  above  theorem  motivates  the  designolion  of  P  as  the  independent  joint  distribution 
forming  mapping  , 

Zadeh  Fuzzy  Set  Theory  Example . 

^  (pointwise) 

(min(  (Pointwise)  ;  all  fuzzy  subsets  j 

j=l>2  I 

^  \  ®  ^  ^  X  ^  >  T(Y)  ;  ,  X^  ,  Y  arbitrary  spaces.  j 


Finitely  Discrete  Probability  Eheorv  Example 

r  (P>5)  =  P*'! 


5(p,q) 


2  (  p(xi)-q(X2)  (M-t-v-.se) 

(Kn 


=  liv  c<  (Vi  .V2  ))  . 

where  r.v.  "V”^ corresponds  to  p  and  r.v.  ■^2  corresponds  to  q  ,  the  two  r.v.’s  being  statis¬ 
tically  independent;  for  all  p  €T()Q  ,  q  £1(3^  ,  o( "X,  “t  T(Y)  , 


Core liar y  to  Theorem  A.  Generalized  "Fuzzification”  Principle . 

Suppose  the  "fuzzy"  theory  under  consideration  is  a  commutative  one.  Let 
f:  X  * • *  *  X  X^  — — ^  Y  be  arbitrary.  Then  ,  using  the  notation  of  Theorem  A, 

T  =  (  e(y)of  );  T(X^)X  •••XT(Xn)  - >  T(Y)  is  an  n-homomorphism  relative  to  the  theory 

which  is  the  unique  extension  of  e(Y)<-f  and  is  also  called  ,  by  definition,  the  B-bomomor- 

phic  extension  of  f .  Note  that  if  n=l,  then  Y  =  #((e(Y^f)  .  f  is  also  the  "fuzzification"of 

f.  ■ 

Let  a  theory  be  commutative  and  as  a  special  case  of  the  above  corollary,  let 

f;  |T^,F^^  X  •••'X  arbitrary  r.»ary  ordinary  truth  table  functldn 

Ot'  logical  operator*  Then  f  is  called  the  "fuzzification  of  operator  f*  Also,  define  the 
"f uzzlfled”  Boolean  logic  associated  with  the  given  theory  as  (  ,  H)  ,  where  H  is  the  set 

of  all  possible  '  fuzzifications"  of  n-ary  logical  operators. 


Zadeh  *  s  Fuzzy  Set  Theory  Example . 

For  any  n-ary  logical  operator  f  and  any  t,  ,..,t  €  ^ 

■L  no 


(f(t, , .  .tn))(  •)  =  sup  min(t3^(x;,),..,t  (x  )) 

V  ef-i(,j/ 


In  particular: 
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For  the  or  operator  or:  ^oX  '^o - ^^o  ^  or(TQ,TQ)ior(T^,FQ)  = 

or(Fo,T„)  ^  To  «nd  or(Fo,F^)^F^  ,  for  all  > 

{or(t^,t2))(  T^)  =  max(  iidn(t3^(To),t2(T^) ) ,niin(ti(T^) ^t^CF^) ) ,min(tj^(F^) ,y  T^) ) )  , 
(5?(tl,t2))(  F^)  =  min(  ti(Fo)>y ^o^). 

For  the  operator  &  ;  ^oX^q— ^ 

=  &(Fo,Fq)  i  F^  ,  for  all  ,t^  €  ^Cq  ■» 

(&(\,t2))(T^J  =  min(t3^(T^),yT^))  , 

(&(t^,t2))(F^)  =  max(min(t^(TQ),t2(F^)),niin(t^(FQ),t^(T^)),min(t^(F^),t2(F^))^^ 

For  the  negation  operator  not:  ^  ^  ^  ,  where  not(Tj^)=F^  and  not(F^)^^  , 

f  or  all  t  €  ^  o  t 

(aot(t))(T^)  =  t(F^)  and  (^(t))(F^)  =  t(To)  , 

Finitely  Discrete  Probability  Theory  Example . 

For  any  n-ary  logical  operator  f  and  any  * 

(f(tj^,..,t^))(-)  =  }  .(ti(x^)-*-t(x„)) 

/xi,,.Xn\ 

\  €f-l(.)/ 

In  particular: 

For  the  operator  or  (as  defined  earlier)  ,  for  all  t^,t2€^  , 

(OT(t^  ^^2))  =  probsura(tj^,t2)  (pointwise)  , 

For  the  operator  &  (as  defined  earlier),  for  all  t^,t2  ^  , 

(S'(tj^,t2))  =  ■^2*^2  (pointwise)  . 

For  the  operator  not  (as  defined  earlier),  for  all  t  ,  , 

o 

fiot(t)  =  1-t  (pointwise)  . 
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6^.  ISSUES  arising  m  modeling  uncertaiwties  /  CONCLUSIONS 


This  section  Is  loosely  held  together  be  the  commonality  of  posing  questions  {  vith 
not  tco  many  answers  at  present,  unfortunately)  concerning  the  natural  questions  that 
arise  .between  natural  language/semantics, linguistics  ,  fuzzy  set  theory  and  probability 
theory  as  approaches  to  the  modeling  of  uncertainty. 

Dubois  &.  Prade  Jill, 2 5 5-264) have  devoted  a  section  of  their  compendium  on  the  develop¬ 
ments  in  fuzzy  set  theory  and  its  applications  to  the  modeling  of  fuzzy  set  membership 
functions.  A  number  of  basic  approaches  are  considered,  with  some  emphasis-as  should  be- 

on  the  empirical  aspects  aspects  of  the  modeling.  In  this  vein,  it  should  be  added  that  the  j 
weak  homomorphic  theory  developed  for  example  in  Appendix  A  Bhows  that  the  idea  of  counting 
percentage  of  times  a  fixed  value  possesses  a  given  attribute  -  which  is  interpreted  as  the 
evaluation  of  the  corresponding  fu6*y  set  membership  function-  as  is  typically  done  by  survey 
sampling  of  individuals,  may  be  identified  with  the  empirical  one  point  coverage  prccocility 
function  generated  by  a  random  sample  of  random  sets  that  are  identically  distributed 
and  are  weak  equivalent  to  the  attribute  or  fuzzy  set  in  question.  However,  the  following  issue 
has  not  been  sufficiently  emphasized:  In  classical  statistical  techniques,  modeling  of  I 

distribution  functions  is  often  carried  out  in  two  basic  steps.  First,  a  parameterized  family  ! 
of  distributions  is  chosen.  This  may  be  for  reasons  of  invariance,  shape,  use  of  Central  Limit  ; 
Theory,  or  via  trends  of  earlier  empirical  evidence.  The  family  is  chosen  so  that  it  reason¬ 
ably  contains  the  viable  alternatives  for  the  true  distibution  and  its  size  is  adjusted  accord- 
ingly.  Then  empirical  data  or  restictions  are  imposed-such  as  unbiasedness, sufficieflcy, minima] 

i 

risk  with  respect  to  some  choice  of  loss  function  on  errors  and  estimates  of  the  unknown  | 

parameter  value  or  outcome  -  yielding  either  a  unique  value  or  a  reduced  set  of  values  where  ! 

the  unknown  parameter  lies.  This  leads  to  the  cocciulion  that  the  same  procedure  should  be 
applied  to  other  approaches  to  uncertainty  modeling,  where  distributlonr, in  now  a  generalized 
or  different  sense  from  the  classical  probabilistic  one,  play  a  key  role  in  the  theory. 

Examples  of  this  are  fuzzy  set  theory,  with  its  fuzzy  set  membership  functions  ,  the  first 
topic  mentioned  above,  flou  set  theory  with  its  index  functions  relative  to  the  individual 


sets  forming  a  given  flou  set ,  and  topclogical  neighborhood  theory  vith  its  neighborhood 
filters.  (See  Manes'  ur.ifted  trsatnent  of  these  theories  as  presented  in  [2?]  or  Sectfan  S 
of  this  paper.) 

Other  analogues  can  be  established  between  fuzzy  set  theory  as  applied  to  parameter 
estimation  and  classical  statistical  estimation  theory.  For  exangjle,  one  can  assvtje  a 
linear  regression  model  is  valid  connecting  observations  with  an  unknown  parameter  vector, 
vith  no  specification  of  the  relevant  distributions  involved-at  least,  at  first.  Then  least 
squares,  or  more  generally,  a  least  weighted  functional  defined  on  the  potential  errors  be¬ 
tween  observations  and  possible  values  of  the  parameter  in  question  ,  is  derli'ed,  yielding 
a  reasonable  value  of  the  unknown  parameter  as  a  function  of  the  observations  ,  i.e.,  a 
statistic,  if  distributional  assumptions  wrre  to  be  made.  Then  if  a  fuzzy  set  modeling 
approach  is  taken,  the  observations  Could  be  assumed  to  be  generated  from  corresponding 
fuzzy  set  membership  functions  ,  yi«lding  in  turn  through  the  standard  fuzzification  of  an 
Ordinary  function  (see  Goodman  [2.?!]  or  Dubois  and  Prade  tllD  for  further  details  on  the  I 
fuzzification  or  equivalently  the  obtaining  of  the  membership  function  of  an:  ordinary 
function  operating  over  a  space  on  which  fuzzy  subsets  are  also  defined  )  the  fuzzy  set 
membership  function  of  the "statistic".  In  turn  this  leads  in  a  natural  way  to  confidence 
sets  for  the  unknown  parameter  vector,  by  for  example  considering  the  level  sets  associated 
with  the  ai'oreraentioned  membership  function.  (See  Goodman  ri2],e.^.  )  for  a  related  technique. 

A  forthcoming  publication  will  consider  this  problem  in  more  detail.)  Asymptotic  properties 
of  these(fuszy  cei )estimator6  may  also  be  obtained  as  the  sample  sizes  are  increased.  Bayesian 
techniques  may  also  be  developed  involving  conditional  distributions  in  the  fuzzy  set  sense  « 
(See  Coednan  QTJ  for  development  of  these  concepts  for  general  fuzzy  set  systems.  See  also 
Dishkant's  related  work  .) 

Is  fuzzy  set  theory  rich  enough  to  model  reasonably  natural  language,  or  can  it  be 
extended  or  modified-  such  as  by  considering, via  the  weak  homomorphic  representation  theory 
of  random  sets  (  see  Appendix  A)»  point  ,  and  tn  general,multipt  point  coverage  functions^! 

i 

i 
i 

i 
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Can  we  express  all  human  (or  other?)  ideas  or  concepts,  rr*  terms  of  natural  language?  Can  these 
ideas  be  reduced  to  primstives  and  operators  involving  them?  Can  a  mathematical/logical 
procedure  be  developed  for  describing  and  analyzing  natural  language  in  a  unified  way, 
including  attributes  and  operators?  What  quantitative  relationships  can  be  established  between 
prelinguistic  ideas  and  natxiral  language?  How  sensitive  or  robust  and  how  subjecti-re  are 
concepts  translated  into  natural  lariguage  with  respect  to  the  particular  language  chosen 
(Vfnorf-Sapir  hypothesis  is  involved,  see  ),  individual  ,  and  medium  used?  Is  there  j 

always  inherent  ambiguity  in  modeling  a  given  concept  in  natural  language?  Can  we  make  use  of 
the  enormous  body  of  literature  available  I’hich  treats  formal  linguistics  and  semantics  to 
develop  a  systematic  unified  framework  directly  relatable  to  multivalued  logic  theory?  In  a 
related  manner,  we  may  ask  if  a  unified  approach  to  uncertainty  models  (  h  la  Manes  (see 
section  5  )  ,  for  example)  and  to  natural  language  would  be  possible?  Can  the  efficiency 
of  the  various  approaches  to  modeling  uncertainty  be  meaningfully  compared? 
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